Green Deep Reinforcement Learning for Radio Resource Management: Architecture, Algorithm Compression, and Challenges

نویسندگان

چکیده

Artificial intelligence (AI) heralds a step-change in wireless networks but may also cause irreversible environmental damage due to its high energy consumption. Here, we address this challenge the context of 5G and beyond, where there is complexity explosion radio resource management (RRM). For high-dimensional RRM problems dynamic environment, deep reinforcement learning (DRL) provides powerful tool for scalable optimization, it consumes large amount over time risks compromising progress made green research. This article reviews analyzes how achieve DRL via both architecture algorithm innovations. Architecturally, cloudbased training distributed decision-making scheme proposed, entities can make lightweight, deep, local decisions while being assisted by on-cloud updating. At level, compression approaches are introduced neural (DNNs) underlying Markov decision processes (MDPs), enabling accurate lowdimensional representations challenges. To scale across geographic areas, spatial transfer proposed further promote efficiency exploiting traffic demand correlations. Together, our algorithms provide vision on-demand capability.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Operation Scheduling of MGs Based on Deep Reinforcement Learning Algorithm

: In this paper, the operation scheduling of Microgrids (MGs), including Distributed Energy Resources (DERs) and Energy Storage Systems (ESSs), is proposed using a Deep Reinforcement Learning (DRL) based approach. Due to the dynamic characteristic of the problem, it firstly is formulated as a Markov Decision Process (MDP). Next, Deep Deterministic Policy Gradient (DDPG) algorithm is presented t...

متن کامل

Energy efficient radio resource management strategies for green radio

Mobile communication industries are increasingly contributing to the worldwide energy consumption and CO2 emission. This paper addresses a number of key radio resource management strategies across PHY and MAC layers for reducing base station energy consumption, as measured by a “Joules per bit” metric. These strategies including power efficient link adaptation, exploitation of multi-user divers...

متن کامل

Deep Reinforcement Learning for Multi-Resource Multi-Machine Job Scheduling

Minimizing job scheduling time is a fundamental issue in data center networks that has been extensively studied in recent years. The incoming jobs require different CPU and memory units, and span different number of time slots. The traditional solution is to design efficient heuristic algorithms with performance guarantee under certain assumptions. In this paper, we improve a recently proposed ...

متن کامل

Deep Reinforcement Learning for Resource Allocation in V2V Communications

In this article, we develop a decentralized resource allocation mechanism for vehicle-to-vehicle (V2V) communication systems based on deep reinforcement learning. Each V2V link is considered as an agent, making its own decisions to find optimal sub-band and power level for transmission. Since the proposed method is decentralized, the global information is not required for each agent to make its...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Vehicular Technology Magazine

سال: 2021

ISSN: ['1556-6080', '1556-6072']

DOI: https://doi.org/10.1109/mvt.2020.3015184